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Abstract. We study the asymptotic behavior of empirical processes generated by measm- 
able bounded functions of an infinite source Poisson transmission process when the session 
length have infinite variance. In spite of the boundedness of the function, the normalized 
fluctuations of such an empirical process converge to a non-Gaussian stable process. This 
phenomenon can be viewed as caused by the long-range dependence in the transmission pro- 
cess. Completing previous results on the empirical mean of similar types of processes, our 
results on non-linear bounded functions exhibit the influence of the limit transmission rate 
distribution at high session lengths on the asymptotic behavior of the empirical process. As 
an illustration, we apply the main result to estimation of the distribution function of the 
steady state value of the transmission process. 



1. Introduction 
We consider the infinite source Poisson transmission process defined by 



(1.1) X{t) = Y,Wel{r 

where the triples {{T£,Y£,Wi), ^ G Z} of session arrival times, durations and transmission 
rates satisfy 

Assumption 1. (i) The arrival times {Ti, I £ Z} are the points of a homogeneous Poisson 
process on the real line with intensity A, indexed in such a way that • • • < r_2 < r_i < 
Po < < Fi < Fa < • • • 
(ii) The durations and transmission rates {(Y,W), {Yi,Wi), ^ G Z} are independent and 
identically distributed random pairs with values in (0, oo) x [0, oo) and independent of 
the arrival times {Ti, ^ G Z}. The random variables Wj are positive with a positive 
probability. The session lengths Yj have finite expectation and infinite variance. 
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(iii) There exist a measure v on (0,oo] x [0, oo] such that i^((l,oo] x [0,oo]) = 1 and, as 
n — )• oo, 

"••((^•"')'-)^''' 

where denotes vague convergence on (0, oo] x [0,oo], and o is the left continuous 
inverse (l/F)^ of l/F. Here F is the distribution function of y, and F = 1 — F is the 
corresponding survival function. 

Assumption 1 (iii) implies several things, listed below. See Heffernan and Resnick (2007). 

• The survival function F is regularly varying with index —a for some a > 0. The 
function a is then regularly varying with index 1/a. 

• The limiting measure is a product measure: 

(1.2) i/ = i/axG, 

where z^q, is a measure on (0,oo) satisfying i/Q,((a;, oo)) = for all x > 0, and G is 
a probability measure on [0, oo]. 

• We have the following weak convergence on [0, oo], as t — t- oo, 

(1.3) F(VF G • I y > t) ^ G . 

We will assume that the exponent a satisfies 

(1.4) l<a<2. 

Under Assumption 1, the process (1.1) is well defined and stationary, see e.g. Fay et al. 
(2007). Under additional moment assumptions, it is shown in this reference that the autoco- 
variance function of the process X is regularly varying at infinity with index 2H — 2 G (—1, 0), 
where H = (3 — a)/2. Such slow rate of decay of the covariance function is often associated 
with long range dependence. 

We are interested in studying the large time behavior of the empirical process 

(1.5) JTi4>) = r 4>{Xh{s)) ds, T > 0, 

Jo 

where h > 0, Xh{s) = {X{s+t) ,0 <t < h}, and (/> is a real valued measurable function defined 
on the space P([0,/i]) endowed with the Ji topology, see for instance Kallcnbcrg (2002). 
We notice that the P([0, /i])-valued stochastic process [Xh{s), s G [0,T]) is continuous in 
probability and, hence, has a measurable version, see Colin (1972). In particular, Jt{4') above 
is a well defined random variable, as long as the function </> satisfies appropriate integrability 
assumptions, e.g. when the function (j) is bounded. 

The case /i = and </>(x) = x has been considered in Mikosch et al. (2002) with Wi = 1 
and by Maulik et al. (2002) in the present context of possible dependence between the session 
lengths and the rewards (transmission rates). These references consider the case where the 
intensity of the point process of arrivals is possibly increasing, which gives rise to the slow 
growth/fast growth dichotomy. In the slow growth case, which includes the case of constant 
intensity, the limit of the partial sum process is a Levy stable process, whereas in the fast 
growth case, the limiting process is the fractional Brownian motion with Hurst index H = 
(3 — a)/2. Here we consider a fixed intensity for the sessions arrival rate, hence are restricted 
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to the slow growth case. On the other hand we take (j) arbitrary (but bounded) and thus 
obtain what appears to be the first result on the asymptotic behavior of the empirical process 
for this type of long range dependent shot noise process. The limit process depends on the 
intensity A, the tail exponent a and the limit transmission rate distribution G defined in (1.3). 
As an illustration, we apply the main result to the estimation of the distribution function of 
the steady state value of the transmission process. Moreover we allow /i > 0. Other potential 
applications of our main result (e.g. to estimation of the multivariate distribution function) 
can be handled in a similar way, but we do not pursue them in this paper. 

Our main result is stated as a functional central limit theorem in the Skorohod Mi topology. 
A convergence result in this topology was obtained in Resnick and van den Berg (2000) for 
a similar traffic model, but with /i = and (i){x) = x. Our result can be viewed as a heavy 
traffic approximation of the content of a fluid queue fed with input cj){X{s)). It shows, in 
particular, that even for </> bounded (e.g. with (t){x) = xAb with b denoting a maximal allowed 
bandwidth), the fluctuations of the asymptotic approximation of the queue content has an 
infinite variance. See also (Resnick and van den Berg, 2000, Section 5). 



2. Notation and preliminary results 



We now introduce some notation and derive certain useful properties of the empirical 
process (1.5) stated in several lemmas whose proofs are provided in Section 5. 

We employ the usual queuing terminology: a time point t is said to belong to a busy period 
if X{t) > 0; it belongs to an idle period otherwise. A cycle consists of a busy period and the 
subsequent idle period. 

Let {Sj,j £ Z} denote the successive starting times of the cycles such that • • • < S-2 < 
S-i < < So < Si < . . . and let Cj = Sj — Sj-i for all j G Z. Hence Sq is the starting time 
of the first complete cycle starting after time (note that So may or may not be equal to the 
first Poisson arrival after time 0), and 5^ = 5*0 + Yl^=i^j- ^'^^ T > 0, let Mt denote the 
number of complete cycles initiated after time 0, and finishing before time T. 

The following facts about M/G/oo queues will be useful. The regenerative property of the 
cycles and (2.1) can be found in Hall (1988). The tail property of Ci is proved in Section 5. 

Lemma 1. Suppose that Assumption 1 holds. Then {{Cj, X{- + S'j_i)l[o,c ))> J — 1} '^''^ 
i.i.d. sequence of random pairs with values in (0, oo) x P([0, oo)), Ci has a regularly varying 
tail with index a and 

(2.1) E[Ci] = e^i^M/A , 

(2.2) limtP(C7i>a(t)a;) = e^'^[^lx-". 



Let be a measurable function defined on D{[0,h]), satisfying appropriate integrability 
conditions for the integral in (1.5) to be well defined (e.g. bounded). We decompose Jt{4') 
using the cycles defined above. Let us denote 

(2.3) Z,{ct>)= / <l){Xh{s))ds, j = l,2,... 
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Then (Zj{(j)))j>i is a stationary sequence, but, if /i > 0, it is not an i.i.d. sequence. Neverthe- 
less, it is easy to see that it is strongly mixing. Define sigma-fields Tj = a{X{Sj + h—s), s > 0) 
and Qj = a{X{Sj > 0) and mixing coefficients {ak)k>i by 

ak = 2sup{|cov(lA, A G Tj,B G Gj^k , j > 1} • 

Then, for all A; > 2, 

(2.4) afc < 2P(5,+fc - Sj+i < h) < P(max(C,+2, • • • , C,+fc) <h) = Fc{hf-^ . 

where Fc denotes the distribution function of Ci. Since Fc{h) < 1 for any h, the mixing 
coefficients decay exponentially fast, independently of (j). This property will be a key 
ingredient to the proof of our result since it implies that, in many aspects, the sequence Zj{<j)) 
has the same asymptotic properties as an i.i.d. sequence. 

We will denote 

(2.5) £{w,(l))=E[cj){w + Xhm], w;e[0,oo), 

whenever the latter expectation is well defined, which is always the case if (j) is bounded. It 
follows from the elementary renewal theorem that that E[Zj((/))] = E[0(X/i(O)]/E[Ci]. This 
identity is stated formally in the following lemma, which also contains another result that 
will be needed later. 

Lemma 2. Suppose that Assumption 1 holds. Let h > and (j) he a hounded measurahle 
function defined on P([0,/i]). We have 

(2.6) E[Zi(0)] =£:(O,0)E[Ci] =E[(/)(X/,(0)]E[Ci] . 

Moreover, for any p £ (1, a), there exists a constant C > and a positive function g depending 
neither on cp nor on T such that g{x) — )• as x —)• oo and 



(2.7) P sup \Jt{<i))-nJM)]\ >x 

\iG[0,T] 



< CT^-P + CTX-P + g{x) . 



For all e,t > let N^^t be the number of sessions of length greater than ea(t) arriving 
and ending within the first complete cycle [Sc^i). Further, we let Y^^t be the length of the 
first session starting at or after 5*0 with length greater than ea(t) and let T^^t and We,t be, 
correspondingly, its starting time and the transmission rate. The following lemma shows that, 
when N^^t > 1, the process {(l){Xh{s)) ,s € [5o,5i)} can be, in certain sense, approximated 
by the step function {i?(VFe,i> '^)l[re t.r^ t+^E O^"*) ' ^ ^ ['S'oj'S'i). (Note that by definition, if 
N,^t > 1, then 5o < F,,* < F^,* + yJ< 5i).'' 

Lemma 3. Suppose that Assumption 1 holds. Let h > and (j) he a hounded measurahle 
function defined on T>{[Q, h]). Let r/ > 0. We have, for all e > sufficiently small, 

(2.8) 



sup 

,i'e[So,5i] 



So 



mx,,{s))-£{W,,t,mir.,,rM^){s)}d, 



>r]a{t);N,,t > 1 =o{t~^) . 



Let W be a closed subset of [0,oo] such that F{W G W) = 1. (Note that by (1.3) this 
implies G(W) = 1.) We introduce the following assumption. 
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Assumption 2. We have 

(2.9) G (!?(£:(•, 0), W)) =0, 

where D{£{-,(j)),W) denotes the set of discontinuity points of the function £{■, (p) restricted to 
W n [0, do), and containing the point oo if oo G W and £{w, (j)) does not converge as t/; — )• oo 
with w e W. (The notation £{oo,(p), when used in the sequel, refers to the continuous 
extension of £{w,4>), and wiU be used only when such an extension exists.) 

Remark 1. If the distribution of W is supported by a closed set consisting of isolated points 
in [0, oo) (which would be the case, for instance, if W was a nonnegative integer- valued 
random variable), then L'(<5(-, (/>), W) is either empty or equal to {oo}. In the latter case, if 
G({oo}) = 0, then Assumption 2 is verified. 



The next lemma, which may be of independent interest, states the multivariate regular 
variation property of the empirical process over a cycle. 

Lemma 4. Suppose that Assumption 1 holds. Let h > and (pi, . . . , (pa be bounded mea- 
surable functions defined on T>{[0,h]) satisfying Assumption 2 with G defined by (1.2). With 
£{w, (pi) = E.[w + (pi{Xh{0))], i = 1, . . . ,d, w > 0, we let 



Si 



So 



PiiXh{s))ds, 



Si 



-1 T 



So 



Pd{Xh{s))ds 



Then Z is multivariate regularly varying with index a. More precisely, the following vague 
convergence holds on [— oo, oo]'^ \ {0} as t ^ oo, 



(2.10) t¥ 



a{t) 



=AE[y] 



/ P {y[£{W\Pi) . . . £iW*,Pd)f e •) a y"""' dy , 

Jy=0 



where W* is a random variable with values in [0, oo] and distribution G. 



3. Main result 

As observed in Resnick and van den Berg (2000), since the limit is discontinuous, the con- 
vergence of the sequence of processes {Zt{<P, t), t > 0} in Theorem 5 cannot hold in I^([0, oo)) 
endowed with the topology induced by Skorohod's Ji distance. We shall prove that the con- 
vergence holds in D([0,oo)) endowed with the topology induced by Skorohod's Mi distance. 

Theorem 5. Suppose that Assumption 1 holds. Let h > and p be a bounded measurable 
function on I?([0, h]) satisfying Assumption 2 with G defined by (1-2). Then, as T ^ oo, the 
sequence of processes Zt{(P,-) defined by 



1 



Tu 



(3.1) Zt{P,u) = —- {P{Xh{s))-E[p{XHm]}ds, u>0, 

) Jo 

converges weakly in T>{[0, h]) endowed with the Mi topology to a strictly a-stable Levy motion 
[A{P,u), n > O) satisfying 

(3.2) Ee**^^'^'") =exp|-n|t|"Ac„E^(VF*,</.) -£:(O,0) "{1 - i;9sgn(t) tan(7ra/2)}} 
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for u >0 and t G M, where Ca = — r(l — a) cos(7ra/2), W* is as in Lemma 4, o,nd 



E 


£iW*,cj))- 






,<!>)- £{0,<P)y 


E 


£{W*, 


ct>)-£{0,(t>) 


a 



Remark 2. For applications of Theorem 5 it is sometimes useful to represent the limiting Levy 
motion (A(i;^, n), n > O) in the form 

(3.3) A((A,ii)= / / {£{w,(p) -£ (0,(1))} Maids, dw) , u>0 , 

Jo Jw 

where Ma is a totally skewed to the right a-stable random measure on (0, oo) x W with 
control measure AcaLeb x G; see Samorodnitsky and Taqqu (1994). The representation (3.3) 
is linear in (p, and this allows, for example, handling more than one function at a time. 

Specifically, if Assumption 1 holds, and is a class of bounded measurable functions sat- 
isfying Assumption 2, then, by linearity, Theorem 5 implies that, for any n >2 and bounded 
measurable functions 0i, . . . , 0„ on P([0, /i]) satisfying Assumption 2, the family of M"-valued 
processes {Zt{(Pi, •), • • • , Zxicpn, •)) converges weakly to the process (A(i;^i, •), . . . , A((/)„, •)) 
in D([0, oo))" endowed with the Mi topology, where the limiting process is understood as to 
be defined by (3.3). Clearly, this limiting process is an M"-valued a-stable Levy motion. 

For another application of (3.3), we can write the one-dimensional weak convergence pre- 
scribed by Theorem 5 at ?x = 1 in the form 

(3.4) Zt{^,1)^Ai{cP):= [ {£{w,<P)-£{0,cl))} Maidw), 

Jw 

where this time Ma is a totally skewed to the right a-stable random measure on W with 
control measure A Ca G. Again, the representation of the limit in the right hand side of (3.4) 
is linear in (f), allowing us to handle more than one function (/) at a time. 

4. An application: the empirical process 

Suppose we want to estimate the distribution function K of X(0). For this purpose we 
consider the family of empirical processes 

Et{x) = T ^ / l{x{s)<x}ds, x>Q. 
Jo 

Let D denote the set of discontinuity points of the distribution function K restricted to 
W n [0,oo). The following is an immediate corollary of Theorem 5 and (3.4). 

Corollary 6. Let X he the collection of x > such that G{x — D) = 0. Then 

{t a{T)'^ {Et{x) - K{x)), x e ^ (P(x), x e X) 

in the sense of convergence of the finite- dimensional distributions, where 

V{x)= I {K{x-w)-K{x)}Ma{dw), x>0. 
Jv\> 

Remark 3. Let us briefly comment on the condition G{x — D) = 0. 
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1. Note that the set D is at most countable, and the set of atoms of G is at most countable 
as well. We immediately conclude that the set X misses at most countably many x > 0. 

2. Further, if the distribution of W is supported by a closed set consisting of isolated point 
in [0,00), we have D = % (see Remark 1), and so X = (0, 00), 

3. Finally, X(0) is an infinitely divisible random variable with Levy measure /i satisfying 

/z((a,oo)) = X&{Y1{W > a)), a > 0. 

Therefore, if W does not have positive atoms, then the distribution function K has a 
single atom, at the origin, implying that D = {0} and X misses some of the atoms of G, 
specifically those atoms that are not isolated points of W. 

Remark 4. It is important to note that estimators based on the empirical process may 
not be able to identify the parameter of interest, even for simple parametric models of the 
distribution of {Y, W). For instance, if Y and W are independent, K depends on the distri- 
bution of Y only through its mean E[y]. This is the main motivation for considering the case 
/i > in Theorem 5 although it is not the object of this paper to provide practical details on 
this application. 

Observe that Corollary 6 shows that "the usual" \/T-rate of convergence of an empirical 
process does not hold in the present situation, since the actual rate of convergence is Ta{T)~^, 
which is regularly varying with index 1 — £ (0, 1/2). This should not be surprising since 
presence of long range dependence has been known to yield slower rates of convergence of the 
empirical process. However we note that in our case the empirical process behaves quite differ- 
ently from the empirical process for other long memory processes, see e.g. Dehling and Taqqu 
(1989); Surgailis (2004). 



5. Proofs 



Proof of Lemma 1. By the definition of a and regular variation of the tail of F, 

F{a{t)) = P(y > a{t)) ~ as t ^ 00; 

recall, further, that a is regularly varying at infinity with index 1/a. We will use the nota- 
tion iVg^t, Y^^t, V^^t and W^^t introduced just before Lemma 3 above. Applying Lemma 1 in 
Rcsnick and Samorodnitsky (1999) and the regular variation of F, we get 

(5.1) lim *(iV, . > 1) = l,m nN.-fy('-;if )) = ,.E[v-|^-<. , 

^ ' t^oo ^ - ' t^oo F{ea{t)) F{a{t) 

Imagine, for a moment, that all sessions of the length exceeding ea(t) are discarded upon 
arrival, and do not contribute to a busy period. Let B^^t denote the length of the first busy 
period starting at or after time Sq and generated by the remaining sessions, those of length 
not exceeding ea(t). Then by (Rcsnick and Samorodnitsky, 1999, Proposition 1), there exists 
a constant D independent of e such that 

(5.2) P {B^^t > eDa{t)) = o{t-^) . 
We immediately conclude that 

(5.3) lim tP(Ci > eDa{t) ■N,t = 0) = 
(keeping in mind that an idle period has an exponential distribution). 
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We consider now the case N^^f > 1, in which case we use the decomposition 

(5.4) Ci = {r,,4 - 5o} + + {Si - (r,,t + y,,t)} . 

By the definition of B^^t, we have, on {N^^t > l}i 

Te,* — Sq < B^^t ■ 

Hence, by (5.2), for any ?y > 0, choosing e > sufficiently small (i.e. e < rj/D where D is as 
in (5.3)), we have 

(5.5) P (re,t - Sq> a{t)r]- N,^t > 1) = o(t"^) as t ^ oo . 

Further, denote by T^^t the completion time of the last session with length greater than ea{t) 
before time Si. Notice that the infinite source Poisson process (1.1) is time reversible, in the 
sense of switching the direction of time, declaring + to be the arrival time of session 
number I and F^ to be its completion time. Therefore, by time inversion, the difference Si—T^^t 
has the same distribution as F^^f — Sq + Iq, where Iq denotes the idle period preceding Sq. 
Moreover the joint distribution of {Si — Fe^t, N^^t) and (F^^j — So + lQ,N^^t) are also the same. 
Since on the event {A'^^^f = 1}, the random variables F^ j + YJ; ^ and F^ ^ coincide, we conclude 
that, for all ry, e > 0, 

(5.6) P {Si - (Fe,t + Y,,t)) > a{t)rj ; N,,t = 1) = P - f^,* > a(t)r?; N,,t = l) 

= P(F,,t-5o + /o > a{t)ij;N,,t = 1) 
< P (Fe,t - S'o > a{t)r]/2; N,^t > 1) + P (/o > a{t)r]/2) = o{t-^) as t ^ oo , 

where the o-term follows from (5.5) and the fact that Iq has exponential distribution. Next, 
by Lemma 2 in Resnick and Samorodnitsky (1999), we also have 

(5.7) P(Af,,t > 2) = o{t~^) ast-foo . 

Applying (5.3), (5.4), (5.5), (5.6) and (5.7), we get, for any a; > > 0, choosing e small 
enough, 

(5.8) liminftP(yet > a{t)x ; iVet > 1) < liminftP(Ci > a{t)x) 

< limsuptP(Ci > a{t)x) < limsupt P(i;,t > a{t){x - r]) ; iV^,* > 1) • 

t—^oo >oo 

Note that the distribution of Y^^t is the conditional distribution of Y given {Y > ea(t)}. and 
that the event {N^^t ^ 1} is independent of Y^^t, so that (5.1) yields, for any x > 0, 

tP(y,,t > a{t)x ; N,^t > 1) ~ e^^[^]e-°P(y > a{t)x \ Y > ea{t)) ^ e^^t^l^"" 

as t — )■ oo. Applying this statement to (5.8) and letting r/ — )• gives (2.2). □ 

Proof of Lemma 2. Observe that the process {X{t),t G M} is a regenerative process (it re- 
generates at the beginning of each busy period), hence it is ergodic. Therefore, r~^j7r(</') — >• 
£{0,(j)) a.s.; see e.g. Resnick (1992). On the other hand, as seen earlier, the sequence {Zj{(j))) 
is strongly mixing, hence also ergodic, and so n-"^ Yl]^=i ^j{4>) converges almost surely to 
E[Zi((/))]. Since Mt/T converges almost surely to l/E[Ci], we also obtain 

Mt 

-Y,zM) ^nzm]/nci] , a.s.. 
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and (2.6) follows. 

Denote (f) = (j) - 
2||(A||oo- We have 

(5.9) 

ie[0,5o] 

For t > So we use the decomposition 



<5(0, (/>). Observe that J7t(</') is centered and 



sup \JS)\ < 



< 



+ \£{o,' 



< 



Now, using 



< 2 



j = l -^^Mf 

\(f)\\oo, (5.9) and that, for all k = 1, Mt + 1, 



we get, for any T > 0, 



sup \Jt( 
te[o,T] 



sup 



> 5x 



Sk- 



< 



< ¥{So >x) + 



sup 

te[o,T] 



Mt 

i=i 



> X 



max Ck > X 

fc=l,...,MT + l 



< F{So >x) + 2F(Mt > 2T/ElCi]) 

k 



+ 



max 

l<fc<2T/E[Ci] 



+ (2T/E[Ci] + i)p((:;i >x) 



> X 



Applying (2.6), we see that Zj{(j)) is centered. Moreover \Zj{(j))\ < 2Cj||(/>||oo- Let p G (l,a). 
Applying the mixing property (2.4), Lemma 1 and Rio (2000, Chapitre 3, Exercice 1), there 
exists a constant c which depends only on the distribution of Ci and p such that 

PI 



(5.10) 



E 



max 

l<fc<n 



< C 



.n . 



i=i 

Finally we bound P(Mr > 2T/E[Ci]) by noting as usual that Mt > n if and only if Sn+i < T. 
Thus, denoting by m the smallest integer larger than or equal to 2T/E[Ci], we have, for some 
constant c only depending on the distribution of Ci and 

(5.11) P(Mt > 2r/E[Ci]) < P(5„ < T) < ¥{Sm - mE[Ci] < -T) < cT^~p , 



where the last inequality follows from the Markov and Burkholder inequalities. Gathering 
the three previous displays and using P(Ci > x) < E,[Cf]x~P for any p < a, we obtain (2.7) 
with g{x) = P{So > x). □ 

Proof of Lemma 3. We will bound the function 



Aft;) 



So 



10 



F. ROUEFF, G. SAMORODNITSKY, AND P. SOULIER 



on the event {N^^t > 1} successively for v G [Sq, T^^t], v G [Te,t,Te,t+Ye,t] and v £ [T^^t+Ye,t, Si]. 
Step 1 For v G [SoiF^.t] we have 



|A(^;)| 



So 



< iTe,t - So 



Hence, using (5.5), for any r] > 0, choosing e > sufficiently small, we have 
(5.12) pf sup \A{v)\ > a{t)ri; N,^t > l] = o{t-'^) . 



Step 2 For V € [T^^t,Te,t + >^e,f], we write 
|A(t;)| < |A(r,,t)| + |A(t;)-A(r,,0 



(5.13) 



< sup |A(?;)| + sup 

i>e[5o,r,,t] ye[o,y,,t] 



r{4>{Xh{r,,t + s))-£{w,,t,<P)}ds 

Jo 



For s > 0, X{r^^t + s) can be expressed as 

X{r,,t + s) = W,,t + X{s) + R{s) , 

where R{s) is the sum of all transmission rates of the sessions that started before time T^^t 
and are still active at time s, and {X{s), s > 0} is defined by 

^(.s) = ^We'^{r,,t<ri<s+r,,t<re+Ye} ■ 

Since each session that arrives after time 5*0 but before time F^ ^ has a length not exceeding 
ea{t), we conclude that R{s) = for s > ea{t). Using the notation Xh{s) = {X{s + v) ,0 < 
V < h}, we, therefore, obtain 

'^cl^iXhiT.^t + s)) - ct>{W,,t + Xh{s))] ds 



(5.14) 



sup 



< 2 



Observe that the process X is independent of (y^,*, W/'e,*, Ia^^ t)>i)- We preserve this inde- 
pendence while transforming X into a stationary process, with the same law as the original 
process X in (1.1) by defining 

X{s) = l{r;<s<r^+y;} + X{s) , seR, 

where {(F^, F/, W^), I £ Z} is an independent copy of {(F^, Ye, We), I £ Z}. Clearly, 
ry 



sup 







{cj)iW,^t + Xh{s)) - <PiW,,t + Xh{s))} ds 



<2||<^IUsup(F; + y;) 

£<0 



where X/i(s) = {X{s + v) ,0 < v < h}. The random variable in the right hand side above 
is finite with probability 1 and independent of N^^f Therefore, it follows from (5.1) that for 
any u > 0, 

P ( sup(F^ + y/) > a{t)u ; A^, * > 1 ) = o{t^^) . 
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The last two displays and (5.14) give that, for any r/ > and < e < 77/(2||i;^)||oo), 
(5.15) 

P( sup r{cP{Xh{T,,t + s))-<PiW,,t+Xhis))}ds 

\ye[0,Ye,t] JO 



> «(t)r?; iV.,i > 1 =oit~^) 



The event {N^^t > 1} is, clearly, independent of (Y^^t,We^t)- Furthermore, the latter pair 
has the conditional distribution of {Y, W) given that {Y > ea{t)}. Since X has the same law 



as X, we get for any x > 0, 

[^{W,,t + Xh{s))-£{W,,tA)} 



(5.16) P sup 



sup 

/ye[o,y] 



{(l)iW + Xhis))-£iW,(^)} ds 



> X ; N,^t > ij 
> X I y > ea{t) I X F{N,^t > 1) 



where the pair (Y, W) in the right hand side is taken to be independent of the process X. 

Recall that £{w,(p) = K[(j){w + Xh{0))], that for any w > 0, \\(j){w + OIU < ||<?5'||oo and, 
for any y > 0, K[J'y{(p{'w + •))] = y£{w^(j)). It follows from these observations and (2.7) in 
Lemma 2 that, for any x > 0, 



supr sup 

«'>0 \ye[0,u] 



{4>{w + Xh{s))-£{w,(t))}ds 



>x||0||oo <Cu^~P + Cux~'' + g{x) 



for p G (l,a), some constant C > and g{x) — t- as a; — )• oo. Integrating in {w,u) with 
respect to the distribution of {W,Y) in (5.16), this bound yields, for any u> and A> 0, 



F sup 

\ymY] 



{^iW + Xh{s))-£iW,^)}ds 



> uA\Y > A 



< CE[Y'~P \Y>A] + C Ml, {uA)-m[Y \Y>A]+ g{uA/Ul 



As ^ ^ oo, we have both E[Y'^~p | y > ^] ^ and A-pE[Y | y > yl] ^ since Y has 
a regularly varying tail with index a > 1 and p £ (l,a). Thus the 3 terms in the previous 
bound converge to as A — )■ oo. This, together with (5.16) and (5.1), yields that, for any 
e > and 7] > 0, 







sup 




Vye[o,K,t] 





[<P{W,,t + Xhis))-£{We,t,cl))] ds 

Finally, gathering the last display, (5.15), (5.13) and (5.12), we obtain 
(5.17) P( sup \A{v)\ > a{t)r]; N,^t > l] = o{t~^) . 
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Step 3 If w G [r,^t + ye,t, Si], we have on {N^^t > 1}, 



\A{v)\ < |A(r,,i + y,,i)| + 



(5.18) < sup \A{v)\ + {Si-{T,,t + Y,,t)} 

«6[r.,t,r,,t+n,t] 

Using (5.17) (5.18), (5.6) and (5.7), for any r/ > 0, we have 

(5.19) p( sup \A{v)\ > a{t)r];N,^t>l] = o{t~^) . 

\veir,,t+Y^,t,Si] ' J 



□ 



Proof of Lemma 4- Let / a Lipschitz function with compact support in [— oo, oo]'^ \ {0}, and 
let L be its Lipschitz constant. Let c > be small enough such that the support of / does 
not intersect [— 2c, 2c]'^. 

Using the fact that Zi{(j)i)\ < \\(j)i\\ooCi for each i = 1, . . . ,d, the bound (5.3) implies that, 
as t — oo, 

F{\Zi{(t)i)\ > ca{t) for some i = 1, . . . ,d; N,^t = 0) = o{t^^) 
as long as e > is small enough relatively to c. We will show that 

(5.20) limlimsupiE[/(Z/a(t)); N^t>l] = lim liminf [/(Z/a(i)) ; N^t>l] 

= emy] / E[f{y[£{W*,cl>i) ... £{W*,cl>i)f)]ay-''-'dy; 
Jo 

this will prove the required vague convergence in (2.10). Write 

(5.21) tE [/(Z/a(t)) ; N,,t > I] = tE [/(*(y.,i, W,,t)/a{t)) ; N,,t > 1] 

+ tE [{/(Z/a(t)) - /(*(y.,t, W,,t)/ait))} ; N,,t > 1] , 

where ^{y,w) = y[£{w,(j)i), . . . ,£{w,(j)ii)^'^ . Choose < rj < c and observe that, on the 
event ni{\Zii^i) - £ {W,,u ^i)Y,,t\ < ??a(t)}, 

|/(Z/o(t)) - fi^{Y,,t,We,t)/ait))\ < L7]l{\£{We,t,q)i)Y,,t\ > m{t) for some i = l,...,d) . 

Letting ^ be a continuous function on [—00,00]"^ such that g{x) = 1 for all x ^ [—c^cf" and 
g{x) = in a neighborhood of the origin, we obtain 

tE [|/(Z/a(t)) - /(*(ye,t, W,^t)/a{t))\ ; iV,,^ > 1] < Lr? tE \g{^{Y,^u W,^t)/a{t)) ; N,^t > 1] + 

d 

2\\fUY.^E {\Zi{ct>i) - £{W,,tAi)Ye,t\ >va{t);N,,t > 1) • 

i=l 

Recall that by Lemma 3, 

lim tF{\Zi{<Pi)-£{W,,t,<Pi)Ye,t\ > m{t) ; A^e,t > 1) = 

t^oo 

for all e > small enough (relative to rf). Therefore, for each > and e > small enough, 
limsup|tE[/(Z/a(t)); iV,,t > 1] - tE [/(*(n,t, M^,,j)/a(t)) ; iV,,^ > 1]| 
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< L7?limsuptE[ff(*(y,,i, ; Ne,t > 1] • 

S-oo 

We will prove below that for any e > 0, 

(5.22) tF (^^^^^ e • ; N,, > l) ^ e^^I^l {u^, x G) o , 

where the measure Va-^e on (0, oo) is the restriction of the measure Va hi (1.2) to (e, oo), i.e. 
Ua;e{x, oo) = min(x~°, e~") , x > 0. Assuming this has been proved, it will follow that 

(5.23) limsnp\tE[{f {Z/a{t)) - f{^{Y,,t,W,,t)/a{t))}; N,,t >l]\<CLr] [ g o ^ d{u^ x G) 

for some finite positive constant C independent of r] and e. Note that the last integral is 

finite. Similarly, (5.22) will imply that 

(5.24) 

limtE[f{^{Y,,t,W,,t)/a{t)); N,,t > 1] = e^^t^^ j /o* d(z.,;,xG) = e^'^l^l j fo^d{u^xG) 

for all < e < c/ max||0||oo. We combine (5.21), (5.23) and (5.24) by keeping r] fixed and 
letting e — 7- 0. This shows that 

-CLi] I go^ d{uc, X G) + e^'^l^l / / o * d{uc, x G) < lim liminf tE [/(Z/a(t)) ; N,t>l] 

J J e— >0 >-oo ' 

< limlimsuptE[/(Z/a(t)); N,t>l]<CLr] [ g o ^ d{i^o. x G) + e^^^^^ [ f o ^ d{u^ x G) , 
f-^O (_^oo ' J J 

and (5.20) follows by letting — 0. 

It remains to prove (5.22). holds. Since the event {N^^t > 1} is independent of (l^^^, W^,*); 
whose distribution is the conditional distribution of (y, VF) given that {Y > ea{t)}, we have, 
as t — oo, 

tF{^iY,,t/ait),W,,t) G •; > 1) =tP(iVM > 1) x F {^(Y/a{t),W) £-\Y> ea{t)) 

~ e^'^I^le"" F (*(y/a(t), W)e-\Y> ea{t)) , 
by (5.1). Further, by Assumption 1 (iii), 

P {{Y/a{t), W)e-\Y> ea{t)) i/^;. x G . 



We extend * to (0, oo) x [0, oo] by 

$(y,oo) = lim ^{y,w) , 

when the limit exists, or by defining the value at infinity to be equal to otherwise. Then 
the set of discontinuities of $ in (0, oo] x W is included in 



(0,CX))X IJ Di£{;<Pi),W) , 



i=l,...A 



which has Va-^ x G-measure zero by (1.2), since each function (pi satisfies Assumption 2. Now, 
since ^{y,w)/a{t) = ^{y /a{t),w), (5.22) follows from the continuous mapping theorem. □ 



2 fSo 1 j-Tu 

Ro,T = -7^ / HXhis)) ds , Rt{u) = — - / ^{Xh{s)) ds 
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Proof of Theorem 5. In order to prove convergence in D{[0,oo)) it is to prove convergence in 
P([0, a]) for any a > 0. For notational simplicity we present the argument for a = 1. 

For any bounded interval [a,b] and real- valued functions xi and X2 in ^([a,?)]) we denote 
by dMi{xi, X2, [a,b]) the Mi distance between xi and X2 on [a,b], and we write dMi{xi,X2) 
if [a,b] = [0, 1]. We refer the reader to Whitt (2002) for details on the Mi and Ji Skorohod 
topologies we use below. 

To simplify the notation we assume that E[i;^(X/i(0))] = 0, i.e. that (p = cj). Define the 
following processes: 

1 1 

St{u) = ^ E ^M) > iT{u) = ^^{Mtu - Tu/E[Ci]) , 

5T(n) = St{Mtu/T) = ^ E ^^•('^) ' 

I rSo rTu 

(recall the convention that, if u < 5*0, then M„ = and, hence, St{u) = 0). Then 

Zt{4>., u) = Ro^T + St{u) + Rt{u) ■ 

We proceed through a sequence of steps. Specifically, we will prove that, as T — )• oo, 

(i) St converges weakly in P([0, oo)) endowed with the Ji topology to the Levy a-stable 
process (E[Ci])i/"A((/>, •), where A is defined by (3.2); 

(ii) converges weakly in 'D([0,oo)) endowed with the Mi topology to an a-stable Levy 
process; 

(iii) St converges weakly in ^([O,^)) endowed with the Ji topology to the Levy a-stable 
process A{(p, •); 

(iv) dMi{<ST, Zt) — in probability. 

The statement of the theorem will follow from statements (iii) and (iv) . It is interesting that 
the statement point (iv) holds even though Rt converges to zero in neither of the Skorohod 
topologies, since otherwise it would then converge uniformly (because convergence in one of 
these topology to a continuous limit implies uniform convergence) , and this would imply that 
Zt weakly converges in the Ji topology to its limit, which is not possible since the limit is 
not continuous. 

We now prove (i). In the case h = 0, the random variables Zj{<j)) are centered and 
their tail behavior is given by Lemma 4. The weak convergence in the space P endowed 
with the Ji topology of the normalized partial sum process St to the a-stable Levy process 
(E[Ci])^''"A(i;^, •) is well know in this case; see e.g. Rcsnick (2007, Corollary 7.1). We reduce 
the case /i > to the previous situation as follows. For j > 1, we write Zj{(j)) = Zij + Z2J 
with 



l-{Sj-h)vSj-i r i-{Sj~h)VSj-i 

Zi,j= / ^{Xh{s))ds-E / (P{Xhis))ds 



'-{Sj~h)VSj-i 
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Observe that the sequence {Zij} is i.i.d. and centered, while the sequence {-^2j} is centered 
and exponentially a-mixing by (2.4)). Furthermore, \Z2j\ < 2\\(j)\\aQh. Therefore, by the 
maximal inequality for mixing sequences Rio (2000, Theorem 3.1), we obtain 

2n 



E 



max 

l<fc<r!. 



1 



k 



a(n) ^ 
^ ' i=i 



2,i 



0(na-2) = 0(1) . 



This implies that the family of processes a(n) ^ X^jli -^2,^ converges weakly to uniformly on 
compact sets. Since the random variables are uniformly bounded, Zij has the same tail 
as Zj. Thus, as in the case h = 0, the family of processes a{n)~^ Sj^i -^ij' converges weakly 
in the space V endowed with the Ji topology to the a-stable Levy process (E[Ci])^/"A((^, •). 
This proves (i). 

By Lemma 1, Mf is the counting process associated with a renewal process whose interar- 
rival times Cj are in the domain of attraction of a stable law with index a. More specifically, 
by Lemmas 1 and 4, the tails of Ci and Zi{(f)) are equivalent. Now (ii) follows from (Wliitt, 
2002, Theorem 4.5.3 and Theorem 6.3.1)). 

We now prove (iii) by the Ji-continuity of composition argument. Observe that St = 
Sto [Mt-/T]. Moreover, Mtu/T = a(T)^T(ii)/T + n/E[Ci] for all u > 0. Since the supremum 
functional is continuous in the Mi topology and a{T)/T — )• 0, we can use (ii) to see that 
Mt-/T converges in the uniform topology on compact intervals to the linear function •/E[Ci] 
in probability. By (i) and Theorem 4.4 in Billingslcy (1968) we conclude that {St, Mt-/T) 
converges weakly to ((E[Ci])i/"A((/>, •), -/HCi]) in the product space P([0, 00)) X P([0,oo)), 
where each of the components is endowed with the Ji topology on compact intervals. Since 
the linear function is continuous and strictly increasing, we can use Theorem 13.2.2 in Wliitt 
(2002)) to conclude that St converges weakly to (E[Ci])1/°A((/>, -/Epi]) in D{[0, 00)) endowed 
with the Ji topology. By the self-similarity of centered Levy stable motions, the latter process 
has the same law as A{(p, ■). This gives (iii). 



It remains to prove (iv). Define the process Zt by 

ZT{t) = ZT{t) - Zt{So/T) = a(r)"i 

Then 



Tt 



So 



(f>iXhis))ds . 



\Zt ~ Zt\ 



1 



So 



Since ST{t) 



a{T) 

for all t G [0, S'o/T], we also have 
sup Z,T{t) — ST{t) 

iG[0,So/T] 



< 



Sq 



a{T) 



op{l) 



< 



Sq 



a{T) 



Next, we partition the random interval [0, Sm^^+i/^] 5 [0, 1] into the adjacent intervals 

[0, So/T] U [5o/r, Si/T] U • • • U [Si_i/r, Si/T] U • • • U [Sm^/T, Smt+i/T] . 

Recall the following property of the Mi metric: if a < 6 < c and xi,X2 are functions in 
D([a, c]) , then 

dMi{xi,X2,[a,c]) <mayi[dMj_{xi,X2,[a,b]), dMi{xi,X2,[b,c\)] . 
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We conclude that 

diMi {St, Zt) < (Imi {Zt, Zt) + cLm^ {Zt, St) 



< "^'I'^f" + . max (ImA^t^St, [Si-i/T, Si/T]) 
a[i ) 1=1,. ..,Mt 

+ [Zt, St, [Smt/T, 1]) . 

Notice that the last term in the right hand side is bounded by ||(/)||ooC'A/j.+i/a(r), and the 
finite mean of Ci implies that the Cmt+i converges weakly as T — t- oo and, in particular, the 
family of the laws of [Cmt+i) is tight. Observe, further, that Zt continuously interpolates 
St at the points t = Si/T, i = 0, 1, 2, . . . . Hence, by (5.11), P(T > Sq) — )■ 1 and stationarity 
we see that for any ij > 0, 

dMAST,ZT)>'n) < ^P(dA/,(^T,5T,[5o/r,5i/T]) >77/2) +o(l) . 

Henceforth we now only consider the process Xfi{t) on [^o, Si]. We use the notation intro- 
duced in Section 2. First of all, 

dMii^T,ST,[So/T,Si/T]) < sup l^r(u) - 5r(ti)| 

ue[So/T,Si/T] 

<a{Tr^ sup r ct){Xh{s))ds<a{Tr^CiM^ . 
ve[So,Si] J So 

Combining this with (5.3) we see that for any rj > 0, 

'dMAZT,ST, [So/T,Si/T]) > r];N,^T = o) = o{T~^) , 

as long as e > is chosen to be small enough. 
Next we consider the event {N^^t > !}• Define 

Mt) = aiT)'' r^£:(Ty,,T,0)l[r,,,r„,+y,,)(s)ds . 

J So 

Observe that Zt is monotone on [Sq/T, Si/T] and piecewise linear and St is constant on 
[Sq/T, Si/T) with a step at the point Si/T. Using these properties it is not difficult to check 
that 

dMAZT,ST, [5o/T, Si/T]) < ^ V \St{Si/T) - Zt{Si/T) 
On the other hand, bounding by the uniform distance gives us 

dMA^T, Zt, [So/T, Si/T]) < sup \ZT{t) - ZT{t)\ ■ 

te[So/T,Si/T] 

Since, by Lemma 1, P(Ci > r]T) = o{T^^), and St{Si/T) = Zt{Si/T), the proof of the 
theorem will be complete once we show that for any > and e > 0, 

P( sup \ZT{t)-Mt)\>V;N,,T>l] =o{T~^) . 
\tG[So/T,Si/T] I 
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However, 



sup \ZT{t)-ZT{t)\ = — ^ sup 

telSo/T,Si/T] a[l ) ve[So,Si] 

and our claim follows from Lemma 3. 



{^iXhis))-£iW, 



So 



e,T, 0)l[r,,T,r„T+n,T) (■5)} 

□ 
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